Oct 24
7
Google limits robots.txt support to four fields, clarifying its stance on unsupported directives. The post Google Updates Robots.txt Policy: Unsupported Fields Are Ignored appeared first on Search Engine Journal .
Read more from the original source:
Google Updates Robots.txt Policy: Unsupported Fields Are Ignored via @sejournal, @MattGSouthern